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Description 

Multiplexed, spatially encoded 
illumination system for determining 
imaging and range estimation 

Federal Research Statement 

[ooo 1 ] Not applicable. 
Background of Invention 

Field of Invention 

[0002] jhj S invention enables the imaging and the range estima- 
tion of elements within a scene using a light source that 
generates a sequentially projected set of spatially encoded 
illumination patterns, a simple receiver, and a data pro- 
cessing device with associated program. 
Description of Prior Art 

[0003] one conventional method for acquiring a digital image of 
a scene is to use an optical system to collect and focus 
light reflected or emitted from objects such that an image 



is formed on a two-dimensional focal plane array of 
photo-sensors, such as a CCD or CMOS sensor. This sys- 
tem produces a one-to-one correspondence between pix- 
els (picture elements) and physical elements in the scene. 
When two images are acquired differing only by a modest 
translation of the camera, the distance or range to objects 
in the field can be determined from the apparent parallax. 
Accuracy improves with increasing lateral displacement, 
however, a fully automated correlation of all elements 
through-out the scene is a difficult data processing task. 
Thus digital range-finder devices are rarely implemented 
to collect range estimations and image acquisition simul- 
taneously throughout a scene. 

[0004] one method for determining an object's range is to mea- 
sure the time of flight for a laser beam pulse to be emit- 
ted, reflected, and then received by a high-speed pho- 
todetector. This light detection and ranging system is of- 
ten referred to as either LIDAR or LADAR. The range is ap- 
proximately one half the time difference between pulse 
emission and detection of the reflected light divided by 
the speed of light in air plus any corrections when the 
emission and detector units are separately located. 

[0005] The invention described in this document integrates the 



functionality of both LIDAR and the digital camera, but 
considerably reduces the system complexity by requiring 
only a single or small number of photo-sensors. 
[0006] a pulsed laser beam is typically used in a LIDAR system 

since it produces a focused, intense spot of light with well 
defined time characteristics. The light pulse can be gener- 
ated by several means, such as by modulating the laser's 
electrical power source, or by mechanically shuttering the 
light beam, or by using saturation and amplification prop- 
erties of components in the laser cavity. The time of flight 
can be determined by measuring the time delay of the de- 
tected waveform between emission and return. Photo- 
sensors or amplified photo-detectors, such as photo- 
multiplier tubes or avalanche photodiodes are typically 
used to convert the optical signal into an electronic signal. 
Alternatively, when the time delay between light pulses in 
a periodic sequence is monotonically decreased or in- 
creased (a method referred to as signal chirping), combin- 
ing the source and detection signals generates a sec- 
ondary frequency component that can be used to indicate 
the range. 

[0007] Unfortunately, the LIDAR method as just described mea- 
sures the range to a single isolated location illuminated by 



the light beam and does not typically measure the relative 
reflectivity of the element. If the ranges of several loca- 
tions in a scene are to be measured, it is necessary to de- 
flect the beam to each location sequentially. Frequently, 
these measurements are taken by either scanning the 
light beam along two orthogonal dimensions using a set 
of computer actuated mirrors, or the beam is scanned 
along one dimension while the scanning system travels 
along the other dimension. The first procedure might be 
used to scan a room with a stationary instrument, while 
the second procedure might be used by a device flown in 
an aircraft to map surface elevations. Typically a data pro- 
cessing system would be used to collect and determine 
the range information associated with each location and 
present the dataset in a manner that can be understood 
by an observer. 

[0008] it has been shown that it is possible to collect both image 
and range data sets simultaneously. Let us define an im- 
age to be a two-dimensional display of picture elements 
(pixels) whose intensity or value is correlated with the 
amount of light reflected by an object element. In conven- 
tional digital photography, the entire pixel array is col- 
lected simultaneously using imaging optics and a focal 



plane sensor array. In these situations, illumination is rel- 
atively constant and uniform over a scene. One means of 
simultaneously collecting image and range information 
would be to build a system with a pulsed illuminator and a 
high spatial resolution array of photosensitive elements 
where the elements measures both the magnitude and 
temporal characteristics of the image. Unfortunately, the 
complexity of building such a photosensitive array makes 
this endeavor either quite expensive or impractical at the 
time of this patent submission. 
[0009] Another means of obtaining range estimates and imaging 
information simultaneously is to use a pulsed illuminator 
and an electronically gated "light valve" that permits only 
light arriving during a specified time duration window to 
be collected. The range information is determined by col- 
lecting a sequence of images where the gated time win- 
dow is methodically scanned through a series of time de- 
lays. The range resolution however, is limited by the mini- 
mum gate resolution which is currently on the order of a 
few nanoseconds, or equivalently, a few feet in length. In 
addition, the time required to analyze a large field of 
range can be considerably long. Still, there are commercial 
imaging systems employing such gated microchannel 



photo-amplifiers. 
[0010] Finally, some commercially available single beam laser 

scanning systems simply measure the signal power as well 
as the time delay at each pixel location and convert this 
power into a pixel intensity after correcting for the power 
fall off with distance. Although the complete range esti- 
mation and imaging process is accurate, the galvanome- 
ters are typically fragile and are not fit for use in many 
situations. 

[0011] This brings us to a technique used in astronomy and 

spectroscopy that bears elements of similarity to the in- 
vention. It is referred to as the multiplexed imaging or 
coded aperture camera concept. In these systems, a se- 
quence of coded amplitude masks are inserted into the 
collection aperture of the optical system of a camera sys- 
tem while signals are acquired. Through an appropriate 
combination of the collected signals, a specific feature can 
be extracted from the data. The encoded aperture typi- 
cally replaces the optical focusing elements and provides 
advantages in light throughput that increases the mean 
power per measurement and improve the signal to noise 
ratio. Our invention differs significantly in that an active 
spatially encoded pulsed illumination system is used in- 



stead of the spatially encoded receiver aperture. Also, a 
temporal analysis of the reflected light provides an addi- 
tional dimension (range) of information. 
Objects and Advantages 

[0012] Several objects and advantages of the proposed invention 
are: 

[0013] ( a ) Reduced complexity and therefore reduced cost in the 
photo-electronic receiver. Since a two-dimensional focal 
plane sensor is not necessary, the ability to simultane- 
ously measure image and range estimates is not be tied to 
a costly effort to develop high resolution photosensor ar- 
rays. Measurements can be accomplished with a single 
high-speed, high-performance photodetector or photo- 
multiplier. 

[0014] (b) The inventions leverages the advantages of the falling 
costs of data processing equipment and inexpensive 
diffractive optical elements. 

[0015] ( c ) Elimination of delicate scanning galvanometers. The 

encoded patterns are generated by illuminating diffractive 
optical elements fabricated on the surface of transparent 
or reflective substrates. These substrates will be mounted 
on rugged computer actuated motors that swiftly pivot or 
translate the pattern into the correct position. 



[0016] (d) Relaxed requirements on the collection optics. Since 
either a single or reduced number of photodetectors are 
needed, there is no longer a need to form a focal plane 
image. The emphasis can be shifted from image quality to 
collection efficiency. 

[0017] ( e ) The invention has flexibility in packaging. The illumi- 
nation, receiving device and data processing device can be 
integrated into a single package, deployed separately, or 
packaged in various combinations. For example, it is fea- 
sible to operate the illuminator from a remote air platform 
and collect light locally. In this manner, the active illumi- 
nation that can draw attention will not reveal the location 
of the remaining modules of the surveillance unit. 

[0018] (f) Diffractive elements generating complex spatially vary- 
ing patterns are relatively easy to design and fabricate. 
They can be easily integrated into the laser illumination of 
LADAR systems. 

[0019] (g) The system can be integrated with conventional scan- 
ning approaches to provide enhanced resolution to these 
system. Thus, this invention can serve as an upgrade for 

existing technologies. 
Summary of Invention 

[0020] This invention uses a pulsed (temporally encoded) light 



source to illuminate an object or scene with a unique se- 
quence of patterns of spatially varying intensities. Since 
the illumination is well defined in time, range information 
can be extracted. The reflected light is detected and am- 
plified to form an electronic signal by either a single 
photo-detector or a small array of photo-detectors. By 
methodically combining the signals generated by the vari- 
ous illumination patterns and measured by the photo- 
detectors, the reflected light signal from a particular re- 
gion in the scene can be isolated and separated from sig- 
nals from other regions. In this manner, the range and re- 
flection intensity (imaging) of each region can be deter- 
mined. The illuminating pattern set may be designed in a 
particular fashion to extract resolution or other image 
features depending on the nature of the use, therefore 
there are potentially a large, arbitrary number of illumina- 
tion patterns sets. 
Brief Description of Drawings 

[0021] Figure 1 shows a block diagram of the multiplexed, spa- 
tially encoded illuminator imaging and ranging system 
modules. 

[0022] Figure 2 shows further details of the illumination module 
1000. 



[0023] Figure 3 shows further details of the receiver module 
3000. 

[0024] Figure 4 shows further details of the pattern generator 
module 1200. 

[0025] Figure 5 shows three methods for pattern presentation. 
Figure 5A shows a pivoting transparent diffractive optical 
element array. Figure 5B shows a translation scanning 
diffractive optical element array. Figure 5C shows a sta- 
tionary dynamically encoded micromirror device array. 

[0026] Figure 6 shows an example of four two-dimensional illu- 
mination patterns. 

[0027] Figure 7 shows an example of the received electronic sig- 
nal formed from the combination of radiance reflected 
from various elements in the scene. 

[0028] The fundamental modules of the system are shown in the 
block diagram in figure 1. Block 1000 is the illuminator 
module that produces the dynamically varying, temporar- 
ily and spatially encoded light intensity patterns. The illu- 
mination module, 1000, may receive control instructions 
through a channel, 7000, from the data processing mod- 
ule, 2000, to indicate which light pattern it should gener- 
ate. It may create a time synchronization signal communi- 
cated through the channel labeled 6000 to indicate the 



reference time of the light pulse, or it may receive a syn- 
chronization command specifying when to emit the illu- 
mination. The radiation pattern emitted is represented by 
arrow 4000. 

[0029] Block 2000 is the data processing system that analyzes 

the collected data received from receiver module, 3000. It 
calculates range and image information and produces 
graphical display or numerical analysis. It may communi- 
cate in either a unidirectional or bi-directional manner 
with the illumination module, 1000, through channels 
6000 or 7000. It retrieves data for processing from the 
receiver module, 3000, as suggested by arrow 8000. Al- 
though the figure indicates that a single data processor 
module is used, the processing may be divided between 
more than one coupled or independent processors. 

[0030] Block 3000 is the receiver module that collects the re- 
flected light, performs a photo-electric conversion to an 
electronic signal and performs signal processing to en- 
hance specific signal characteristics. It receives reflected 
light from the object as specified by arrow 5000 and re- 
lays electronic data and signals to the processing module, 
2000, through the channel labeled 8000. 

[0031] Arrow 4000 illustrates that the radiation propagates from 



the illumination module, 1000, to the object or scene be- 
ing observed. 

[0032] Arrow 5000 illustrates that the scene or object reflects a 
portion of the incident light back to the invention receiver 
module 3000. 

[0033] Arrow 6000 indicates that timing synchronization data 
and commands are exchanged between the illumination 
module, 1000, and the data processing module, 2000. 

[0034] Arrow 7000 indicates that a signal is exchanged between 
module 1000 and module 2000 to indicate which illumi- 
nation pattern of the pattern set is in use. A dual ended 
arrow is shown to indicate that either the module 1000 is 
indicating the current pattern to module 2000, or that 
module 2000 is instructing module 1000 to select a spec- 
ified pattern, or that that an instruction and acknowledge- 
ment is exchanged between modules 1000 and 2000. In 
certain embodiments, data representing the generating 
pattern may be communicated from the processing mod- 
ule 2000 to the illumination module 1000. 

[0035] Arrow 8000 indicates that the processed signal measured 
in the receiver module 3000 is provided to the data pro- 
cessing module 2000 for analysis. 

[0036] Figure 2 shows a detailed block diagram of the illumina- 



tion module 1000. A light source 1100 such as a laser 
generates the irradiance. This irradiance, 4100, is trans- 
ferred to and manipulated in the pattern generator mod- 
ule 1200 such that a dynamically changing, spatially en- 
coded light intensity pattern is formed at the object. The 
output irradiance, 4200, is sent to module 1300 which is 
an optional set of optical elements which may or may not 
be needed to assist in directing the light to the scene. For 
example, the elements may focus the light pulse, 4200, or 
control the deflection of the beam. The irradiance leaves 
the system as indicated by arrow 4000. Although the light 
source could be further decomposed, the nature of the 
source is not crucial to the this invention and a detailed 
examination would be dependent on the particular light 
source chosen. Arrow 6000 indicates that timing synchro- 
nization information and commands are exchanged be- 
tween the light source 1100 and the data processing 
module, 2000. Arrow 7000 indicates that data and control 
information regarding the illumination patterns are ex- 
changed between the pattern generator, 1200, and the 
data processing module, 2000. 
[0037] Figure 3 shows a detailed block diagram of the receiver 

module 3000. Light 5000 reflected from the distant object 



is collected by the optical system 3300 and usually fo- 
cused as indicated by arrow 5100 onto a photosensitive 
device 3200. The collection optics, 3300, may include a 
multiplicity of refractive lenses and/or reflective mirrors, 
plus optical filters that block all light except that which 
falls within the spectral region of the emitting illuminator. 
If required, there may also be mechanical shutters or light 
modulators for blocking light from outside the time inter- 
val of interest and apertures for closing the system when 
the device is not being operated. The photosensitive de- 
vice, 3200, converts the optical signal into an electronic 
signal, 5200. The electronic signal, 5200 is then transmit- 
ted to the signal processing module 3100 for enhance- 
ment. The enhanced signal 8000 is finally transmitted to 
the data processing module 2000. 
[0038] Figure 4 shows a functional breakdown of the pattern 

generation module 1200 which is a part of the illumina- 
tion module 1000. The pattern presenter 1210 is the de- 
vice that holds the generating pattern that manipulates 
the light beam such that the spatially encoded illumina- 
tion pattern is formed at the object. The pattern selector 
module 1250 is either an electronic or mechanical device 
that selects which spatial pattern is encoded into the light. 



In some embodiments, modules 1210 and 1250 may be 
integrated within a single device. Module 1250 communi- 
cates with module 2000 through channel 7000 to deter- 
mine what pattern is selected for use. 

[0039] Figure 5 shows further detail of the pattern presentation 
module 1200. Illustrated are three embodiments of tech- 
nology that manipulates the incoming light beam 4100 to 
form an encoded light beam 4200. Each part of the figure 
shows a perspective that is viewed primarily from the side 
and partially to the rear of the piece. 

[0040] The top mechanism shown by figure 5A is composed of a 
motor and shaft 1211 that pivots an optically transparent, 
round, disc-shaped element 1212. The element 1212 has 
a number of pattern generating designs placed on or 
within the surface. Part 1213 represents one of these gen- 
erating pattern designs placed in the beam path. 

[0041] Th e middle figure 5B shows a second embodiment. The 
motor assembly 1221moves the pattern holder 1222 
along two axis independently. The movement is primarily 
lateral to the light beam 4100. Again, the transparent sur- 
face of 1222 is covered with generating pattern designs. 
One such pattern, 1223, is shown. 

[0042] The bottom embodiment in figure 5C shows a mechanism, 



1232, which can reconfigure its generating pattern de- 
sign, 1233, using an array of micromechanical devices 
such as micro mirror arrays. In this case, the device is re- 
flective. A data processing element, 1231, is used to store 
generating patterns and to control the state of device 
1232. In each case data and control information is com- 
municated with the data processing module 2000 through 
channel 7100. 

[0043] Figure 6 gives a simple example of a spatial pattern that 
could be generated by the illuminator module (1000). Pat- 
tern 1010 shows a rectangular beam that is subdivided 
into four regions and labeled parts a, b, c, and d. In this 
figure, a white box indicates a higher intensity region and 
a dark box indicates a low intensity region. In pattern 
1010, all four regions have high intensities. Patterns 
1010, 1020, and 1030 show three other different combi- 
nations. This figure is meant to serve as an example. Pat- 
terns used in the invention will have greater complex and 
diversity. 

[0044] Figure 7 shows a simple example of the electronic signals 
that could be received when several scene locations are il- 
luminated simultaneously. Item 1000 is the illumination 
module emitting four pulsed beams in this example. The 



top beam hits a highly reflective element, 4010, and pro- 
duces the top signal in 4050 if only this region is illumi- 
nated. Beam 4020 strikes a semi-transparent object and a 
more distant object. The 2nd signal from the top in 4050 
shows how the first object produces a smaller signal due 
to the partial reflectance, and the second object creates a 
delayed pulse that is smaller due to the greater distance. 
Beam 4030 creates a small pulse due its darker color, and 
beam 4040 creates a intermediate size pulse at an inter- 
mediate delay. Since the invention uses a single photode- 
tector, the signals from all beams would be superimposed 
on each other and appear as the signal represented by 

4060. 
Detailed Description 

Fundamental Operation 

[0045] | n order that we may distinguish the spatially encoded 

light intensity patterns that illuminate the object from the 
patterns on the physical structure that are used to manip- 
ulate the light beam waveform, we will refer to these re- 
spectively as the illumination patterns and the generating 
patterns. A simple example of illumination patterns shown 
in figure 6 parts 1010 through 1040 will be discussed 



later. The form of the generating patterns will depend on 
the manner in which the light is manipulated and, in gen- 
eral, may bear no resemblance to the illumination pattern. 
[0046] The key features of this invention are: 

[0047] ( a ) Assembling a pulsed light source (which can be ac- 
complished using commercially available systems). 

[0048] (b) Assembling a high-speed photo-detector and A/D sig- 
nal sampling system (which can be accomplished using 
commercially available equipment). 

[0049] ( c ) choosing and designing the generating patterns corre- 
sponding to the illumination pattern (using a variety of 
methods discussed below). 

[0050] (d) Affixing the generating patterns to a computer con- 
trolled mechanical translation stage or motor (using tech- 
niques to be described). 

[0051] ( e ) writing a computer application for controlling the sys- 
tem and acquiring the signal data via a data processing 
system. 

[0052] (f) Determining the appropriate combination of signals in 
order to isolate an image element or other feature (using 
techniques described below.) 

[0053] (g) writing a computer application for combining the sig- 
nals, analyzing the separated data channels, and present- 



ing the range and/or image information in a manner that 
can be interpreted by a user. 
[0054] The invention operates in the following manner: The sys- 
tem selects one particular illumination/generating pattern 
combination from the available set. The generating pat- 
tern may be a permanent structure, such as a microscopic 
surface-relief pattern etched into a glass-like substrate or 
a data element that is used to configure a microscopic ar- 
ray of deflective micromirrors. The illuminator module is 
configured so that the generating pattern is moved into 
the beam path. A light pulse is generated and the wave- 
front is modified by the generating pattern element. Next, 
optional optical elements relay the light toward the object 
where a structured illumination pattern is produced. Light 
is reflected by the object and returns to the receiver where 
it is collected by optics, converted to an electronic signal 
by a high-speed photodetector, and then sampled and 
stored by a data processing module. The pulse may be re- 
peated to improve the statistics on the signal. Next, the 
illumination module selects a new generating pattern and 
repeats the process. This sequence is repeated with each 
generating pattern until a suitable number of signals has 
been collected. The data processing unit then combines 



the signals in a specific manner until either a signal from 
an isolated region or other suitable feature has been ex- 
tracted. This individual signal can then be further ana- 
lyzed to measure range and or intensity information. 
[0055] Finally, the image, range, and/or other feature sets of the 
scene are shown on a graphics display (flat or stereo- 
scopic) in a manner that is understood by a human user or 
can be interpreted by processing applications that are not 

necessarily an integral part of this invention. 
Means of Encoding the Illumination 

[0056] y\/ e will describe two means of encoding the light intensity 
patterns. 

[0057] The preferred embodiment of this technique is to use 

diffractive optical elements to manipulate the structure of 
the light beam's wavefront and thereby redistribute the 
far-field irradiance energy. 

[0058] This is accomplished by adding spatially variant phase de- 
lay and/or by spatially absorbing radiant energy laterally 
across the beam cross-section. A second embodiment is 
to use a spatially variant filter or pattern to absorb radi- 
ance energy across the beam cross section and to then 
use an optical system to re-image this pattern at the loca- 
tion of the object. The first embodiment is preferred be- 



cause the distant illumination pattern generally does not 
change with transmitted distance except for scaling with 
distance, and optical components for shaping the light 
beam into Gaussian beam are typically suitable. However, 
the second embodiment may suffer from depth of focus of 
restrictions throughout the range of operation and will 
probably require an optical system with better perfor- 
mance. 

[0059] The generating patterns that modify the wavefront of the 
light beam such that it forms spatially encoded intensity 
distributions at the object can be physically realized by 
several means. Figure 5 shows several embodiments using 
either a transparent or reflective substrate with an area of 
surface relief microstructures. These microstructure are 
typically just larger than the dimensions of the wavelength 
of the illuminating light beam. In the top and middle 
mechanisms, the generating patterns are predetermined 
and permanently manufactured onto the substrate. The 
substrate is then either rotated or shifted to select the ap- 
propriate pattern. In the lower mechanism, a device such 
as a micromirror array or an LCD array is used. The gen- 
erating pattern is then dynamically presented on the de- 
vice under electronic control. This feature provides the 



ability to dynamically calculate specific generating pat- 
terns that can be tailored to the situation. The drawback is 
that these micromechanical array devices may have lower 
spatial resolution then the previous scheme and may 
therefore generate illumination patterns of less complex- 
ity. 

Means of Determining the Generating Patterns 

[0060] The spatial distribution of the light at the object can typi- 
cally be calculated using scalar diffraction theory 
(integrated with an optical analysis of any optional optics), 
although rigorous couple wave analysis may be needed for 
very complex and fine structures. The microstructure 
serves to manipulate the impinging waveform by creating 
a spatially varying phase delay across the light beam. 

[0061] As a specific example, one particular scheme would be to 
form a two-dimensional pattern that is periodically re- 
peated across the pattern presentation substrate. Scalar 
diffraction theory holds that a regularly spaced array of 
beams are generated at a substantial distance from the 
system. This array of beams can be designed with arbi- 
trary intensities. The angular spacing between beams 
along one dimension, 0 is constant and, for small angles 
is given by the formula, 0=X/P, where A is the wavelength 



of the laser light and P is the period size of the basic gen- 
erating pattern. According to scalar diffraction theory, the 
relative intensities of the beam array is given by the math- 
ematical Fourier Transform of the structure of the base 
pattern. A one-dimensional pattern requires a one- 
dimensional Fourier analysis, while a two-dimensional 
pattern requires a two-dimensional Fourier analysis. 
[0062] | t should be noted that there are a variety of optical analy- 
sis methods for determining how a suitably modified 
wavefront evolves into an illumination pattern at a dis- 
tance from the structured element. Some of these ele- 
ments are referred to in technical literature as (amplitude 
and phase) gratings, kinoforms, diffractive optical ele- 
ments, Fresnel and Fourier holograms, and so on. The in- 
vention does not rely on a particular method of calculation 
to determine the structure of the generating pattern. It is 
only necessary that a set is designed and that the relative 
combination of signals generated by the illumination be 
analyzable. 

[0063] a partial list of devices that be used to create diffractive 

generating patterns are: 
[0064] . phase modulating diffractive pattern on an optically 

transparent substrate, 



[0065] . modulating diffractive pattern on an optically reflective 
substrate, 

[0066] . amplitude modulating diffractive pattern on an optically 

transparent substrate, 
[0067] . amplitude modulating diffractive pattern on an optically 

reflective substrate, 
[0068] . combination phase and amplitude modulating diffractive 

pattern on an optically transparent substrate, 
[0069] . combination phase and amplitude modulating diffractive 

pattern on an optically reflective substrate, 
[0070] . a micro-mirror device array (amplitude modulation), 

[0071] . an LCD spatial light modulator (amplitude or phase 

modulation), 
[0072] . a hologram. 

[0073] The illumination patterns can be chosen arbitrarily or else 
they can be selected from sets of previously determined 
patterns or codes. The selection may be based on a spe- 
cific feature or component for which the user is searching, 
or it may be based on the mathematical complexity or 
ease of extraction of the signal analysis. For example, pe- 
riodic horizontal or vertically aligned bands of light maybe 
used be used to search for specific Fourier frequency 



components. Or a coded sequence of binary amplitude 
patterns, such as Hadamard codes, may be used to de- 
compose the scene from low resolution to high resolution 
components. 

[0074] Once the illumination patterns have been selected, various 
means can be used to determine the corresponding gen- 
erating patterns. For example, in one configuration a sim- 
ple Fourier transform of the illuminating pattern can be 
used to calculate the generating pattern, however, this 
straight-forward transform typically results in a mixed 
amplitude and phase modulated structure which is cur- 
rently difficult to construct. 

[0075] it is often useful to restrict the diffractive element to ei- 
ther a pure amplitude modulation or pure phase modula- 
tion structure and additionally to quantize the phase or 
amplitude levels to a fixed number of values. In either of 
these two cases, an optimization process can be used to 
determine the pattern. We will summarize one optimiza- 
tion method, referred to as the Cerchberg-Saxton tech- 
nique. Here, the illumination intensity pattern is Fourier 
transformed into a generating pattern, then the undesired 
phase or amplitude information is removed, and the re- 
sultant pattern is inverse Fourier transformed to recover a 



resultant illumination pattern. During that step, intensity 
variations have been unintentionally introduced into the 
illumination pattern, so the desired amplitude is restored 
(saving the phase information) and the cycle is repeated. 
Ideally, the corrections at each of the optimization cycles 
converge and eventually a suitable generating pattern has 
been generated. 

[0076] it should be noted that some schemes for generating spa- 
tially encoded illumination may also generate a minor 
amount of radiance outside the designated pattern region. 
For example, in a diffractive optical system, it is typical to 
manipulate the waveform so that between 80%and 95% of 
the radiant energy is coupled into the desired spots within 
a confined region of interest. The remaining radiation is 
typically scattered outside the defined region and the dis- 
tribution will vary from pattern to pattern. For this reason 
it may be important to place beam stops or apertures on 
the outgoing illumination to remove this extraneous light 
or else to somehow account for the addition of this noise 
in the processing of the signals. The important point is to 
note that there a number of methods to adjust for this ef- 
fect and that the optimal solution will depend on the 
practical implementation. 



Means of determining the decoding combinations 

[0077] one means of determining the appropriate combination of 
signals that reconstructs the radiance from an isolated re- 
gions is to begin by representing the complete set of 
measured signals from all patterns as a vector, s(t) with 
individual measurements from a specific pattern, s (t). The 

i 

signal that we wish to isolate from a localized region is r 
(t) and the full data set from all regions is r(t). Typically, 
we would chose the range of i to equal the range of j. 

[0078] Each illumination pattern, P determines the radiant en- 

j 

ergy on a specific scene element by casting spatially vary- 
ing patterns of intensity. Thus we would write that Pj 
(intensity pattern) multiplies the vector r(t) (scene ele- 
ment's range response) to create the combined measure- 
ment s (t). In matrix form this can be written as the opera- 

i 

tion, 

[0079] p . r(t ) = S ( t ). 

[0080] The solution to determining each r (t) is to calculate the 

inverse matrix, P -1 such that, 
[0081] r ( t ) = p _1 . s (t). 

[0082] Thus in general, the sequence or set of patterns should 
form a matrix representation that is invertible. 



Example of a decoding sequence 

[0083] The data processor is used to extract and isolate the in- 
tensity and ranging information for a specific spatial re- 
gion using defined combinations of each of the collected 
signals. We will illustrate this concept by means of a sim- 
ple example. 

[0084] Figure 6 will help illustrate how a sequence of patterns 

can be used to extract the signal from an isolated region. 
Here, we use a two-dimensional 2x2 array, although a 
one-dimensional pattern or a non-square two- 
dimensional pattern could also be applied. We will assume 
binary intensity levels (a low intensity and high intensity 
level), however, multiple intensity levels and non-uniform 
intervals could also be applied. 

[0085] v\/e will label the four regions as a, b, c, and d. The signal 
that we would receive if we isolated "a" would be a(t), from 
"b" would be b(t), etc. When the patterns are projected on 
the scene, a, b, c, and d, will hold range and intensity in- 
formation from specific elements in the scene. The task 
will therefore be to isolate these values. 

[0086] when the scene is illuminated, a signal will be measured 
that contains contribution from a, b, c, and d. We will des- 
ignate the pattern associated signals for as A(t) for the 



combined signal from the first pattern, B(t) as the com- 
bined signal from the second pattern, etc. 

[0087] v\/e will use the pattern values from the figure equating a 1 
to a white region and a 0 to a dark region. In the first pat- 
tern, all four regions are equally illuminated with a high 
intensity beam. Thus signal could be written: 

[0088] A (t) = a(t)+b(t)+c(t)+d(t). 

[0089] The signal from the second pattern would be: 
[0090] B(t) = a(t) + b(t). 

[0091] The signal from the third pattern would be: 
[0092] C (t) = a(t) + c(t). 

[0093] anc j the signal generated by the fourth pattern would be: 
[0094] D (t) = b(t) + c(t). 

[0095] The objective is to combine elements of A(t), B(t), C(t), and 
D(t)in order to recover a(t), b(t), c(t), d(t). From these re- 
sults we will be able to determine range and image infor- 
mation for this 2x2 area. 

[0096] one method to determine isolated range and image infor- 
mation is to cast the data as a matrix operation. Combin- 
ing the preceding relations, we would then have: 

[0097] 
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[0098] using linear algebraic methods, we could determine the 
solution to be: 

[0099] 
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[0100] Thus, the signal from region "a" would be given by: 

[0101] aft) = 1/2 ■ (Bft) +C(t) - D(t)) 

[0102] th e signal from region "b" would be given by: 

[0103] bft) = 1/2 ■ (Bft) - Cft) + D(t)) 

[0104] the signal from region "c" would be given by: 

[0105] C ( t ) = 1/2 ■ (-B(t) - Cft) + D(t)) 

[0106] anc | the signal from region "d" would be given by: 

[0107] d(t) = 1/2 ■ (2 Aft) - Bft) - Cft) - Dft) 



Means of determining the range 



[0108] ideally, the resultant processed and analyzed signal will 
contain a single, short duration pulse that is a delayed 
version of the intensity modulation of the source laser 
pulse. The range to the object can then be determined by 
calculating the time difference between the source pulse 
and signal pulse, dividing by the speed of light in air (or 
appropriate media), and correcting for system geometry. 
In a simple configuration where illuminator and sensor are 
located relatively close compared to the object distance, 
the correction may be to divide the calculation by a factor 
of two. Configurations where illuminator and sensor are 
not collocated will require additional corrections. 

[0109] |f semi-transparent objects fall along the ray from the il- 
luminator to the target, a series of additional pulses may 
appear in the isolated signal. Additionally, if a consider- 
able number of patterns are used, or if there is movement 
in the scene, or if the relative signal power has fallen to a 
level comparable to the noise inherent in the system, then 
a number of extraneous pulses or level fluctuations may 
appear in the signal. It is task of the analysis application 
to determine whether or not to filter these potentially 

spurious results. 
Means of determining the reflection intensity 



[0110] if the isolated signal pulse is relatively strong relative to 
system noise, then integrating the pulse strength indi- 
cates the relative intensity of the reflection from the re- 
gion. It will likely be necessary to scale the measurement 
by range to account for reduced light collected at greater 
distances. Assigning these intensities to a grid will gener- 
ate an image of the scene. 
Using the invention to enhance prior art 

It is also possible to create a hybrid system that uses this 
invention in addition to techniques from prior art. The 
reason to consider such a combination is due to the re- 
duced signal-to-noise ratio and large data sets that might 
be collected using the proposed invention when attempt- 
ing to isolate individual signals when large collections are 
attempted. For example, a two-dimensional 4x4 illumi- 
nating pattern might require 16 measurements, whereas a 
32x32 pattern might require a data set that is 64 times 
larger and the relative signal component reduced by a 
factor of 64 relative to the full strength. Given the noise 
inherent in a practical signal amplification system, there 
will likely be a configuration where higher spatial resolu- 
tion leads to worse reconstruction performance unless 
greater laser power and higher performance photodetec- 



tors are used. 

[0112] one embodiment would be to integrate the invention with 
a system that uses a set of computer actuated mirrors that 
operates by deflecting the beam in order to provide addi- 
tional scanning resolution. The mirror system would be 
contained in module 1300 of the illumination module as 
illustrated in figure 2. 

[0113] Currently, mirror scanning systems operates at a slower 
speed than the dynamically encoding scheme. Therefore 
the mirror scanner might be chosen to provide the coarse 
pointing granularity with fine or interscan imaging gener- 
ated by the proposed invention. In the combined system, 
the full multiplexed analysis of the invention could occur 
at a specific mirror orientation, and then repeated as re- 
quired at additional orientations. In this manner, the reso- 
lution of the system could be enhanced, or the scanning 
speed of the prior art system could be significantly im- 
proved. Full resolution would be created by combining the 

calculated range and intensities from all data sets. 
Additional feature of the invention 

[0114] one important consequence of this invention is that the 

illuminator and the detector can be separated by a signifi- 
cant distance and that it is not necessary for the receiver's 



collection optics to be able to resolve an image of the 
scene. Therefore the receiver may collect light from a re- 
mote location and still simultaneously recover imaging 
and ranging information that would not be possible from 

a focal plane imager. 
Conclusion, Ramifications and Scope 

[0115] This invention introduces an economical and robust 

means of determining range and image information from 
a scene using actively encoded illumination, a single ele- 
ment photodetector and data processing equipment. It's 
chief advantage over prior-art focal plane solutions is 
shifting the complexity from the expensive sensor module 
to the illumination and data processing modules where al- 
ternative uses of similar technology is rapidly reducing 
costs. The invention also has advantages over traditional 
laser scanning devices because it replaces delicate gal- 
vanometers with simpler computer actuated motors and 
translators. Ultimately, the integration of micro-mirror ar- 
rays and other micro-actuated arrays will totally eliminate 
the need for large-scale mechanical parts. 

[0116] This invention uses an illuminator that generates a se- 
quence of encoded radiant patterns and an associated 
data processing module that analyzes the multiplexed 



data sets to determine region specific range and imaging 
information. By using a single element photodetector, the 
system has a large dynamic sensitivity and achieves sig- 
nificantly better performance than conventional photo- 
sensor arrays. 

[0117] This referenced illumination system can be inexpensively 
manufactured, can withstand rugged handling, and can be 
packaged into an inexpensive and compact system. These 
advantages promote the possibility of hand-held LIDAR 
imagers which will encourage their use for rapid 3D scene 
and object reconstruction or integration into miniature air 
reconnaissance vehicles. Since the spatially encoded pat- 
terns will be sequenced at a high rate, the projected illu- 
mination will likely appear to be a uniform intensity beam 
to the human eye. Therefore the instrument could very 
well serve a dual function as flashlight and range/imaging 
camera. 

[0118] Finally, this technique can also be integrated with prior art 

line scan techniques to dramatically enhance their spatial 

resolution and functionality. 
[° 119 ] Since the invention operates with a single photodetector, 

it can be designed to operate over a large spectral range. 

Indeed, if the photodetector module is constructed to be 



interchangeable, then the system can operate at multiple 
spectral regions. Also, the photodetector/photomultiplier 
can be designed to operate over a large dynamic range 
providing a significant advantage over complex sensor ar- 
rays. 

[0120] Although we have suggested that the scope of the inven- 
tion includes characterization of human scale objects (i.e., 
meters to 10's of meters), the invention can scale to either 
microscopic scale regions or larger scale scenes if the ac- 
curacy of the temporal analysis can be maintained. In ad- 
dition, the invention is not limited to the ordinary visual 
spectrum and can be applied to other radiant sources 
provided the temporal characteristics of the radiant pulse 
can be adequately controlled. 



